Real Time Data Mining, Management, and Visualization of GCM Output

The output of simulations (e.g., global circulation models) can run into terabytes. The computational cost as well as the cost of storing and retrieving model data can be quite high. Recently there have been some e orts to develop on-line visualization capabilities that can be used, for example, to monitor whether the model is behaving properly. There are however, many other uses for on-line data analysis including feature extraction, computational steering of the model, and controlled saving of model output (e.g., more frequent samples of state information under certain conditions). Each of these applications is a potential client of model output data. We present a software architecture which stresses modularity and exibility and supports a variety of clients. Some preliminary performance numbers are given from a prototype implementation. Real Time Data Mining, Management, and Visualization of GCM Output Edmond Mesrobian, Richard Muntz, and Eddie Shek Data Mining Laboratory Computer Science Department University of California, Los Angeles Los Angeles, CA 90024 Email: fedmond,muntz,[email protected] Carlos R. Mechoso, John D. Farrara, and Joesph A. Spahr Department of Atmospheric Sciences University of California, Los Angeles Los Angeles, CA 90024 Email: fmechoso,farrara,[email protected] Paul Stolorz Jet Propulsion Lab California Institute of Technology Pasadena, CA 91109 Email: [email protected]